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Operations Security Techniques: 
An Analysis of GIANT SCALE (U) 



Occasionally, quantitative methods - 
or operations research techniques, if you will - can be 
used effectively in attacking complex threat analysis 
problems which confront the operations security (OP- 
SEC) community from time to time. This is the story 
of one such cas e involving a threat p osed by North 
Korean (DPRK) | [ to SR-71 recon- 

naissance operations in the Far East; these operations 
are known by the unclassified nickname, GIANT 
SCALE. 



Background (U) 



In early 1 976, | 



about the continued effectiveness of OPSEC measures 
which had been introduced some fourteen months 
before. When the situation continued i nto May, CINC- 
PAC decided to take a closer look at 

| GIANT SCALE. At 
issue was whether the North Koreans had regained 
actual foreknowledge of SR-71 sorties, as some sus- 
pected, or whether they were simply guessing. 

The Analysis (U ) 

This posed an interesting challenge to 
,the analysts involved. By special arrangement with 



/of GIANT SCALE sorties staging; f Through 

I ! similar arrangements with SAC, it was possible to 

| I the Pacific Com- assemble all relevant operational data for the same 

mand, SAC, | | agreed j j j period. 

to collaborate on an OPSEC field survey of the Formally, the hypothesis to be tested 

operation. Accordingly, a joint survey team was assem- was that DPRK l |had foreknowl- 

bled and tasked to evaluate the planning, coordination, edge of S R-71 operations 

and execution procedures for the missions and to ~| This turned out to be a relatively complex' 

examine such diverse support activities as transpor- issue because of various unknowns which had to be 

tation, refueling, maintenance, and communications. reckoned with. For example, what assumptions were 

Conclusions and recommendations of that survey have to be made about the North Koreans’ perceptions and 

been fully documented in CINCPACs GIANT SCALE motivations? Which data were relevant and which 

OPSEC Survey Report (1976) and need not be reiter- irrelevant? And, ultimately, how could the issue be 

ated here. It will suffice to say that several problems decided? Therefore, the analysts decided to examine 

were uncovered and that, in February 1977, remedies the hypothesis of foreknowledge from two perspectives: 

were implemented which curtailed even the hint of 1. That the North Koreans had prior awareness of 

prior awareness for the next fourteen months. all CR-71 sorties I /including 



The Problem (U ) 
fSrhj B 



tor the next tourteen months. all SR-71 sorties /including 

j) both operational missions and training flights, and 

2. That the North Koreans had prior awareness of 
But then, beginning in April 1978, operational missions only. 

” A third alternative concerning train- 

ing sorties only was rejected as insignificant from a 

probability as well as an OPSEC standpoint; training 

I some concern i sorties never approached the sensitive area around 
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Korea and never entered North Korean radar range. 
It was al so necessary to allo w for the possibility that 
observed I I to the SR-71 could have 



reflected either all sorties scheduled or only sorties 
actually flown, alternatives which would have indicated 
significantly d ifferent levels 6f insight. 

TS*5L___r 




Sorties scheduled 
Sorties flown 
Operational missions 
scheduled 



1 1 1 days 
85 days 
61 day9 



serious OPSEC concern. Looking at percentages alone 
gave no clue to the mystery, and some other approach 
clearly had to be taken. This is where some simple 
operations research techniques came in. 

The approach taken was to test a 
complementary hypothesis that the observed pattern 




of DPRK f | did not reflect foreknowledge but 
rather whs random - which is to say, the North 
Koreans were guessing. The analysts reasoned that if 
the number of correct alerts proved to be consistent 
with a pattern of random guessing, it could be con- 
cluded there was no problem. On the other hand, if 
the number of correct alerts was too high, then the 
original hypothesis of prior awareness could be sup- 
ported^ even though the North Koreans’ record was 
less than perfect. 

The tools (U) 

(U) As it turned out, a distribution known 

as the binomial was perfect for the problem at hand. 
It is not important to understand the mathematics of 
this distribution, but only to know that it can enable 
an analyst to determine his expectations about any 
event which has only two possible outcomes - the 
event can either occur or not occur. 

(U) From the data available, the proba- 

bility of an event in any of the four above-mentioned 
domains of interest can be estimated simply by divid- 
ing the number which occurred by 180 days. The 
analysts found the probability of a sortie being flown 
on any given day to be 85/180 = .47; the probability 
of a sortie being scheduled was 111/180 = .62, and so 
on. Using probabilities derived in this way, the ana- 
lysts were able to use the binomial distribution to 
determine an average number of right guesses to be 
expected in a random guessing scheme, as well as the 
chances of getting any specific number correct. 1 

For the sake of brevity, the ensuing 
discussion focuses only on sorties and operational 
missions actually flown, but scheduled events were 
analyzed in a similar way. Consider the following: 

SORTIES flown Pr (sortie): 85/180=. 47 

Expected average # correct guesses (.47x8) 3.76 
Observed average correct 3 

Observed maximum correct 4 

MISSIONS FLOWN Pr (mission): 52/180=. 29 

Expected average # correct guesses (.29x8) 2.32 
Observed average correct 2 

Observed maximum correct 3 



1 (U) It may be argued that the binomial model is 

not precisely correct in this circumstance because GIANT SCALE 
had a quota of missions to be completed each month. Consequently, 
the events were not truly independent, resulting in a situation where 
the probability of missions later in the month could vary depending 
on how many had been completed earlier. However, the actual 
distribution of events was such that any errors incurred were not 
large and could be safely ignored. 
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-rsty Using these data and a standard table 

of the binomial distribution, which can be found in 
any probability or statistics reference, it was deter- 
mined that the probability of 4 or fewer correct 
guesses occurring in 8 tries was about .43 (this is for 
all sorties flown). Furthermore, the chances of never 
getting more than 4 correct guesses during any of the 
six months were calculated as (.43) 6 , or only about 6 
in a thousand. This is a rather small number and 
suggests that the North Koreans not only did not have 
foreknowledge, but their performance was considerably 
worse than could have been expected from a purely 
random guessing scheme. What a surprising result! 

(sl>^ One explanation for this result, and 

the one finally settled on by the analysts, was that 
the North Korean I 



To 

illustrate this point, we may contrast the first result 
with probabilities calculated for operational missions 
only. In this case, the probability of 3 or fewer correct 
guesses in 8 tries was found to be .95, and the 
probability of getting a maximum of 3 right in any six 
consecutive months to be (.95) 6 or .73. These numbers 
are significantly different and quite consistent with a 
pattern of guessing, as the analysts had postulated. 
So while both measures tended to refute the prior- 
awareness theory, only the second one made much 
sense in context of the presumed domains of interest. 

Just to be sure, the analysts applied 
one additional te chnique to confirm their judgment 
about the pattern f ) This technique involved 

use of another well-known probability distribution — 
the normal distribution. Although binomial analysis 
had suggested the North Koreans were anticipating 
operational missions exclusively, the aggregate time 
profiles of sorties flown and missions flown looked fairly 
similar when charted by day of month, week, and time 
of day. Consequently, it was difficult to discriminate 
between them when making comparisons with the 
Some other measure was needed, so 



the analysts decided to examine not the date/times of 
discrete events but rather the intervals between them. 
It was reasoned that if the av erage time betw een 

yet 



missions was similar to the time[_ 



significantly different from the interval between sorties 
as a whole, then the binomial analysis would be 
confirmed. 



The Solution (U) 

This turned out to be true. The ma- 
nipulation of data in this case required a mean and 
standard deviation to be calculated for each of the 
three sample distributions. Without going into com- 
putational detail, it will be sufficient to note that the 
mean times between missions I Iwere 3.49 



days and 3.89 days, respectively, but that the interval 
for all Sorties was only 2.20 days. This was found to 
be a statistically significant difference. 
rs\ And so the myBtery was solved. Using 

new primary data and a variety of analytical tech- 
niques, the analysts were able to conclude that the 
North Koreans ha d not regained prior awareness of 
SR-7 1 operations 



Furthermore, the 



analysts were able to infer that the pattern f | 

]was attributable to 



educated guessing or anticipation 6n the DPRKs part, 
and that this anticipation was probably based on the 
pattern of operational GIANT SCALE missions the 
North Koreans were able to perceive by radar tracking, 



Conclusion (U) 



point of this story is 



(U) The important 

simply that quantitative techniques can be very useful 
in the analysis of complex OPSEC questions. Some- 
times, as in this case, they might even be crucial to 
the successful resolution of a problem. Every OPSEC 
analyst should at least be aware of these techniques 
and their value in solving problems under conditions 
of uncertainty. This does not mean every analyst needs 
to be a statistician to succeed in the OPSEC business; 
as with lawyers and engineers, you don’t have to be 
one to use one. But it does mean keeping an open 



mind and having the good sense 
needed. 



to ask for help when 



(U) pas been em- 

ployed by the National Security Agency since 
1964- Most of that time he has served in the 
Communications Security Organization. He par- 
ticipated in the original joint OPSEC survey of 
GIANT SCALE conducted in 1976, and at the 
time of this writing was NSA’s representative to 
the CINCPAC Operations Security Staff. 
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